Timestamp for saved files: 2020-12-10_17-15-10
Training parameters
Number of epochs: 100
Step size maximum: 0.02
Step size decay: 9.9995e-05
Batch size: 64
Regularization rate: 0.0001
Saving validation predictions in: /Usersß/Josh Ehrlich/Courses/CISC881/Project/data\PredictionsValidation
Saving models in: /Usersß/Josh Ehrlich/Courses/CISC881/Project/data\SavedModels
*** Leave-one-out round # 0
Training on 5803 images, validating on 1515 images...
[<tf.Tensor 'conv2d_8/Relu:0' shape=(None, 4, 4, 128) dtype=float32>]
Model: "functional_1"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d (Conv2D) (None, 128, 128, 16) 160 input_1[0][0]
__________________________________________________________________________________________________
batch_normalization (BatchNorma (None, 128, 128, 16) 64 conv2d[0][0]
__________________________________________________________________________________________________
spatial_dropout2d (SpatialDropo (None, 128, 128, 16) 0 batch_normalization[0][0]
__________________________________________________________________________________________________
conv2d_1 (Conv2D) (None, 128, 128, 16) 2320 spatial_dropout2d[0][0]
__________________________________________________________________________________________________
batch_normalization_1 (BatchNor (None, 128, 128, 16) 64 conv2d_1[0][0]
__________________________________________________________________________________________________
max_pooling2d (MaxPooling2D) (None, 64, 64, 16) 0 batch_normalization_1[0][0]
__________________________________________________________________________________________________
conv2d_2 (Conv2D) (None, 64, 64, 32) 4640 max_pooling2d[0][0]
__________________________________________________________________________________________________
batch_normalization_2 (BatchNor (None, 64, 64, 32) 128 conv2d_2[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_1 (SpatialDro (None, 64, 64, 32) 0 batch_normalization_2[0][0]
__________________________________________________________________________________________________
conv2d_3 (Conv2D) (None, 64, 64, 32) 9248 spatial_dropout2d_1[0][0]
__________________________________________________________________________________________________
batch_normalization_3 (BatchNor (None, 64, 64, 32) 128 conv2d_3[0][0]
__________________________________________________________________________________________________
max_pooling2d_1 (MaxPooling2D) (None, 32, 32, 32) 0 batch_normalization_3[0][0]
__________________________________________________________________________________________________
conv2d_4 (Conv2D) (None, 32, 32, 64) 18496 max_pooling2d_1[0][0]
__________________________________________________________________________________________________
batch_normalization_4 (BatchNor (None, 32, 32, 64) 256 conv2d_4[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_2 (SpatialDro (None, 32, 32, 64) 0 batch_normalization_4[0][0]
__________________________________________________________________________________________________
conv2d_5 (Conv2D) (None, 32, 32, 64) 36928 spatial_dropout2d_2[0][0]
__________________________________________________________________________________________________
batch_normalization_5 (BatchNor (None, 32, 32, 64) 256 conv2d_5[0][0]
__________________________________________________________________________________________________
max_pooling2d_2 (MaxPooling2D) (None, 16, 16, 64) 0 batch_normalization_5[0][0]
__________________________________________________________________________________________________
conv2d_6 (Conv2D) (None, 16, 16, 128) 73856 max_pooling2d_2[0][0]
__________________________________________________________________________________________________
batch_normalization_6 (BatchNor (None, 16, 16, 128) 512 conv2d_6[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_3 (SpatialDro (None, 16, 16, 128) 0 batch_normalization_6[0][0]
__________________________________________________________________________________________________
conv2d_7 (Conv2D) (None, 16, 16, 128) 147584 spatial_dropout2d_3[0][0]
__________________________________________________________________________________________________
batch_normalization_7 (BatchNor (None, 16, 16, 128) 512 conv2d_7[0][0]
__________________________________________________________________________________________________
max_pooling2d_3 (MaxPooling2D) (None, 8, 8, 128) 0 batch_normalization_7[0][0]
__________________________________________________________________________________________________
conv2d_8 (Conv2D) (None, 4, 4, 128) 147584 max_pooling2d_3[0][0]
__________________________________________________________________________________________________
conv2d_transpose (Conv2DTranspo (None, 8, 8, 58) 29754 conv2d_8[0][0]
__________________________________________________________________________________________________
concatenate (Concatenate) (None, 8, 8, 186) 0 conv2d_transpose[0][0]
max_pooling2d_3[0][0]
__________________________________________________________________________________________________
conv2d_9 (Conv2D) (None, 8, 8, 58) 43210 concatenate[0][0]
__________________________________________________________________________________________________
batch_normalization_8 (BatchNor (None, 8, 8, 58) 232 conv2d_9[0][0]
__________________________________________________________________________________________________
conv2d_10 (Conv2D) (None, 8, 8, 58) 13514 batch_normalization_8[0][0]
__________________________________________________________________________________________________
batch_normalization_9 (BatchNor (None, 8, 8, 58) 232 conv2d_10[0][0]
__________________________________________________________________________________________________
conv2d_transpose_1 (Conv2DTrans (None, 16, 16, 26) 6058 batch_normalization_9[0][0]
__________________________________________________________________________________________________
concatenate_1 (Concatenate) (None, 16, 16, 90) 0 conv2d_transpose_1[0][0]
max_pooling2d_2[0][0]
__________________________________________________________________________________________________
conv2d_11 (Conv2D) (None, 16, 16, 26) 9386 concatenate_1[0][0]
__________________________________________________________________________________________________
batch_normalization_10 (BatchNo (None, 16, 16, 26) 104 conv2d_11[0][0]
__________________________________________________________________________________________________
conv2d_12 (Conv2D) (None, 16, 16, 26) 2730 batch_normalization_10[0][0]
__________________________________________________________________________________________________
batch_normalization_11 (BatchNo (None, 16, 16, 26) 104 conv2d_12[0][0]
__________________________________________________________________________________________________
conv2d_transpose_2 (Conv2DTrans (None, 32, 32, 10) 1050 batch_normalization_11[0][0]
__________________________________________________________________________________________________
concatenate_2 (Concatenate) (None, 32, 32, 42) 0 conv2d_transpose_2[0][0]
max_pooling2d_1[0][0]
__________________________________________________________________________________________________
conv2d_13 (Conv2D) (None, 32, 32, 10) 1690 concatenate_2[0][0]
__________________________________________________________________________________________________
batch_normalization_12 (BatchNo (None, 32, 32, 10) 40 conv2d_13[0][0]
__________________________________________________________________________________________________
conv2d_14 (Conv2D) (None, 32, 32, 10) 410 batch_normalization_12[0][0]
__________________________________________________________________________________________________
batch_normalization_13 (BatchNo (None, 32, 32, 10) 40 conv2d_14[0][0]
__________________________________________________________________________________________________
conv2d_transpose_3 (Conv2DTrans (None, 64, 64, 2) 82 batch_normalization_13[0][0]
__________________________________________________________________________________________________
concatenate_3 (Concatenate) (None, 64, 64, 18) 0 conv2d_transpose_3[0][0]
max_pooling2d[0][0]
__________________________________________________________________________________________________
conv2d_15 (Conv2D) (None, 64, 64, 2) 146 concatenate_3[0][0]
__________________________________________________________________________________________________
batch_normalization_14 (BatchNo (None, 64, 64, 2) 8 conv2d_15[0][0]
__________________________________________________________________________________________________
conv2d_16 (Conv2D) (None, 64, 64, 2) 18 batch_normalization_14[0][0]
__________________________________________________________________________________________________
batch_normalization_15 (BatchNo (None, 64, 64, 2) 8 conv2d_16[0][0]
__________________________________________________________________________________________________
conv2d_transpose_4 (Conv2DTrans (None, 128, 128, 2) 18 batch_normalization_15[0][0]
__________________________________________________________________________________________________
conv2d_17 (Conv2D) (None, 128, 128, 2) 18 conv2d_transpose_4[0][0]
==================================================================================================
Total params: 551,588
Trainable params: 550,244
Non-trainable params: 1,344
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x0000024487812520>
WARNING:tensorflow:From <ipython-input-7-639783e879e1>:175: Model.fit_generator (from tensorflow.python.keras.engine.training) is deprecated and will be removed in a future version.
Instructions for updating:
Please use Model.fit, which supports generators.
Training time: 4:50:14.250505
(1515, 128, 128, 1)
Total round time: 4:50:28.189714
*** Leave-one-out round # 1
Training on 6290 images, validating on 1028 images...
[<tf.Tensor 'conv2d_26/Relu:0' shape=(None, 4, 4, 128) dtype=float32>]
Model: "functional_3"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_2 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_18 (Conv2D) (None, 128, 128, 16) 160 input_2[0][0]
__________________________________________________________________________________________________
batch_normalization_16 (BatchNo (None, 128, 128, 16) 64 conv2d_18[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_4 (SpatialDro (None, 128, 128, 16) 0 batch_normalization_16[0][0]
__________________________________________________________________________________________________
conv2d_19 (Conv2D) (None, 128, 128, 16) 2320 spatial_dropout2d_4[0][0]
__________________________________________________________________________________________________
batch_normalization_17 (BatchNo (None, 128, 128, 16) 64 conv2d_19[0][0]
__________________________________________________________________________________________________
max_pooling2d_4 (MaxPooling2D) (None, 64, 64, 16) 0 batch_normalization_17[0][0]
__________________________________________________________________________________________________
conv2d_20 (Conv2D) (None, 64, 64, 32) 4640 max_pooling2d_4[0][0]
__________________________________________________________________________________________________
batch_normalization_18 (BatchNo (None, 64, 64, 32) 128 conv2d_20[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_5 (SpatialDro (None, 64, 64, 32) 0 batch_normalization_18[0][0]
__________________________________________________________________________________________________
conv2d_21 (Conv2D) (None, 64, 64, 32) 9248 spatial_dropout2d_5[0][0]
__________________________________________________________________________________________________
batch_normalization_19 (BatchNo (None, 64, 64, 32) 128 conv2d_21[0][0]
__________________________________________________________________________________________________
max_pooling2d_5 (MaxPooling2D) (None, 32, 32, 32) 0 batch_normalization_19[0][0]
__________________________________________________________________________________________________
conv2d_22 (Conv2D) (None, 32, 32, 64) 18496 max_pooling2d_5[0][0]
__________________________________________________________________________________________________
batch_normalization_20 (BatchNo (None, 32, 32, 64) 256 conv2d_22[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_6 (SpatialDro (None, 32, 32, 64) 0 batch_normalization_20[0][0]
__________________________________________________________________________________________________
conv2d_23 (Conv2D) (None, 32, 32, 64) 36928 spatial_dropout2d_6[0][0]
__________________________________________________________________________________________________
batch_normalization_21 (BatchNo (None, 32, 32, 64) 256 conv2d_23[0][0]
__________________________________________________________________________________________________
max_pooling2d_6 (MaxPooling2D) (None, 16, 16, 64) 0 batch_normalization_21[0][0]
__________________________________________________________________________________________________
conv2d_24 (Conv2D) (None, 16, 16, 128) 73856 max_pooling2d_6[0][0]
__________________________________________________________________________________________________
batch_normalization_22 (BatchNo (None, 16, 16, 128) 512 conv2d_24[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_7 (SpatialDro (None, 16, 16, 128) 0 batch_normalization_22[0][0]
__________________________________________________________________________________________________
conv2d_25 (Conv2D) (None, 16, 16, 128) 147584 spatial_dropout2d_7[0][0]
__________________________________________________________________________________________________
batch_normalization_23 (BatchNo (None, 16, 16, 128) 512 conv2d_25[0][0]
__________________________________________________________________________________________________
max_pooling2d_7 (MaxPooling2D) (None, 8, 8, 128) 0 batch_normalization_23[0][0]
__________________________________________________________________________________________________
conv2d_26 (Conv2D) (None, 4, 4, 128) 147584 max_pooling2d_7[0][0]
__________________________________________________________________________________________________
conv2d_transpose_5 (Conv2DTrans (None, 8, 8, 58) 29754 conv2d_26[0][0]
__________________________________________________________________________________________________
concatenate_4 (Concatenate) (None, 8, 8, 186) 0 conv2d_transpose_5[0][0]
max_pooling2d_7[0][0]
__________________________________________________________________________________________________
conv2d_27 (Conv2D) (None, 8, 8, 58) 43210 concatenate_4[0][0]
__________________________________________________________________________________________________
batch_normalization_24 (BatchNo (None, 8, 8, 58) 232 conv2d_27[0][0]
__________________________________________________________________________________________________
conv2d_28 (Conv2D) (None, 8, 8, 58) 13514 batch_normalization_24[0][0]
__________________________________________________________________________________________________
batch_normalization_25 (BatchNo (None, 8, 8, 58) 232 conv2d_28[0][0]
__________________________________________________________________________________________________
conv2d_transpose_6 (Conv2DTrans (None, 16, 16, 26) 6058 batch_normalization_25[0][0]
__________________________________________________________________________________________________
concatenate_5 (Concatenate) (None, 16, 16, 90) 0 conv2d_transpose_6[0][0]
max_pooling2d_6[0][0]
__________________________________________________________________________________________________
conv2d_29 (Conv2D) (None, 16, 16, 26) 9386 concatenate_5[0][0]
__________________________________________________________________________________________________
batch_normalization_26 (BatchNo (None, 16, 16, 26) 104 conv2d_29[0][0]
__________________________________________________________________________________________________
conv2d_30 (Conv2D) (None, 16, 16, 26) 2730 batch_normalization_26[0][0]
__________________________________________________________________________________________________
batch_normalization_27 (BatchNo (None, 16, 16, 26) 104 conv2d_30[0][0]
__________________________________________________________________________________________________
conv2d_transpose_7 (Conv2DTrans (None, 32, 32, 10) 1050 batch_normalization_27[0][0]
__________________________________________________________________________________________________
concatenate_6 (Concatenate) (None, 32, 32, 42) 0 conv2d_transpose_7[0][0]
max_pooling2d_5[0][0]
__________________________________________________________________________________________________
conv2d_31 (Conv2D) (None, 32, 32, 10) 1690 concatenate_6[0][0]
__________________________________________________________________________________________________
batch_normalization_28 (BatchNo (None, 32, 32, 10) 40 conv2d_31[0][0]
__________________________________________________________________________________________________
conv2d_32 (Conv2D) (None, 32, 32, 10) 410 batch_normalization_28[0][0]
__________________________________________________________________________________________________
batch_normalization_29 (BatchNo (None, 32, 32, 10) 40 conv2d_32[0][0]
__________________________________________________________________________________________________
conv2d_transpose_8 (Conv2DTrans (None, 64, 64, 2) 82 batch_normalization_29[0][0]
__________________________________________________________________________________________________
concatenate_7 (Concatenate) (None, 64, 64, 18) 0 conv2d_transpose_8[0][0]
max_pooling2d_4[0][0]
__________________________________________________________________________________________________
conv2d_33 (Conv2D) (None, 64, 64, 2) 146 concatenate_7[0][0]
__________________________________________________________________________________________________
batch_normalization_30 (BatchNo (None, 64, 64, 2) 8 conv2d_33[0][0]
__________________________________________________________________________________________________
conv2d_34 (Conv2D) (None, 64, 64, 2) 18 batch_normalization_30[0][0]
__________________________________________________________________________________________________
batch_normalization_31 (BatchNo (None, 64, 64, 2) 8 conv2d_34[0][0]
__________________________________________________________________________________________________
conv2d_transpose_9 (Conv2DTrans (None, 128, 128, 2) 18 batch_normalization_31[0][0]
__________________________________________________________________________________________________
conv2d_35 (Conv2D) (None, 128, 128, 2) 18 conv2d_transpose_9[0][0]
==================================================================================================
Total params: 551,588
Trainable params: 550,244
Non-trainable params: 1,344
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x00000244AF695A60>
Training time: 5:10:34.646047
(1028, 128, 128, 1)
Total round time: 5:10:44.194631
*** Leave-one-out round # 2
Training on 6670 images, validating on 648 images...
[<tf.Tensor 'conv2d_44/Relu:0' shape=(None, 4, 4, 128) dtype=float32>]
Model: "functional_5"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_3 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_36 (Conv2D) (None, 128, 128, 16) 160 input_3[0][0]
__________________________________________________________________________________________________
batch_normalization_32 (BatchNo (None, 128, 128, 16) 64 conv2d_36[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_8 (SpatialDro (None, 128, 128, 16) 0 batch_normalization_32[0][0]
__________________________________________________________________________________________________
conv2d_37 (Conv2D) (None, 128, 128, 16) 2320 spatial_dropout2d_8[0][0]
__________________________________________________________________________________________________
batch_normalization_33 (BatchNo (None, 128, 128, 16) 64 conv2d_37[0][0]
__________________________________________________________________________________________________
max_pooling2d_8 (MaxPooling2D) (None, 64, 64, 16) 0 batch_normalization_33[0][0]
__________________________________________________________________________________________________
conv2d_38 (Conv2D) (None, 64, 64, 32) 4640 max_pooling2d_8[0][0]
__________________________________________________________________________________________________
batch_normalization_34 (BatchNo (None, 64, 64, 32) 128 conv2d_38[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_9 (SpatialDro (None, 64, 64, 32) 0 batch_normalization_34[0][0]
__________________________________________________________________________________________________
conv2d_39 (Conv2D) (None, 64, 64, 32) 9248 spatial_dropout2d_9[0][0]
__________________________________________________________________________________________________
batch_normalization_35 (BatchNo (None, 64, 64, 32) 128 conv2d_39[0][0]
__________________________________________________________________________________________________
max_pooling2d_9 (MaxPooling2D) (None, 32, 32, 32) 0 batch_normalization_35[0][0]
__________________________________________________________________________________________________
conv2d_40 (Conv2D) (None, 32, 32, 64) 18496 max_pooling2d_9[0][0]
__________________________________________________________________________________________________
batch_normalization_36 (BatchNo (None, 32, 32, 64) 256 conv2d_40[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_10 (SpatialDr (None, 32, 32, 64) 0 batch_normalization_36[0][0]
__________________________________________________________________________________________________
conv2d_41 (Conv2D) (None, 32, 32, 64) 36928 spatial_dropout2d_10[0][0]
__________________________________________________________________________________________________
batch_normalization_37 (BatchNo (None, 32, 32, 64) 256 conv2d_41[0][0]
__________________________________________________________________________________________________
max_pooling2d_10 (MaxPooling2D) (None, 16, 16, 64) 0 batch_normalization_37[0][0]
__________________________________________________________________________________________________
conv2d_42 (Conv2D) (None, 16, 16, 128) 73856 max_pooling2d_10[0][0]
__________________________________________________________________________________________________
batch_normalization_38 (BatchNo (None, 16, 16, 128) 512 conv2d_42[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_11 (SpatialDr (None, 16, 16, 128) 0 batch_normalization_38[0][0]
__________________________________________________________________________________________________
conv2d_43 (Conv2D) (None, 16, 16, 128) 147584 spatial_dropout2d_11[0][0]
__________________________________________________________________________________________________
batch_normalization_39 (BatchNo (None, 16, 16, 128) 512 conv2d_43[0][0]
__________________________________________________________________________________________________
max_pooling2d_11 (MaxPooling2D) (None, 8, 8, 128) 0 batch_normalization_39[0][0]
__________________________________________________________________________________________________
conv2d_44 (Conv2D) (None, 4, 4, 128) 147584 max_pooling2d_11[0][0]
__________________________________________________________________________________________________
conv2d_transpose_10 (Conv2DTran (None, 8, 8, 58) 29754 conv2d_44[0][0]
__________________________________________________________________________________________________
concatenate_8 (Concatenate) (None, 8, 8, 186) 0 conv2d_transpose_10[0][0]
max_pooling2d_11[0][0]
__________________________________________________________________________________________________
conv2d_45 (Conv2D) (None, 8, 8, 58) 43210 concatenate_8[0][0]
__________________________________________________________________________________________________
batch_normalization_40 (BatchNo (None, 8, 8, 58) 232 conv2d_45[0][0]
__________________________________________________________________________________________________
conv2d_46 (Conv2D) (None, 8, 8, 58) 13514 batch_normalization_40[0][0]
__________________________________________________________________________________________________
batch_normalization_41 (BatchNo (None, 8, 8, 58) 232 conv2d_46[0][0]
__________________________________________________________________________________________________
conv2d_transpose_11 (Conv2DTran (None, 16, 16, 26) 6058 batch_normalization_41[0][0]
__________________________________________________________________________________________________
concatenate_9 (Concatenate) (None, 16, 16, 90) 0 conv2d_transpose_11[0][0]
max_pooling2d_10[0][0]
__________________________________________________________________________________________________
conv2d_47 (Conv2D) (None, 16, 16, 26) 9386 concatenate_9[0][0]
__________________________________________________________________________________________________
batch_normalization_42 (BatchNo (None, 16, 16, 26) 104 conv2d_47[0][0]
__________________________________________________________________________________________________
conv2d_48 (Conv2D) (None, 16, 16, 26) 2730 batch_normalization_42[0][0]
__________________________________________________________________________________________________
batch_normalization_43 (BatchNo (None, 16, 16, 26) 104 conv2d_48[0][0]
__________________________________________________________________________________________________
conv2d_transpose_12 (Conv2DTran (None, 32, 32, 10) 1050 batch_normalization_43[0][0]
__________________________________________________________________________________________________
concatenate_10 (Concatenate) (None, 32, 32, 42) 0 conv2d_transpose_12[0][0]
max_pooling2d_9[0][0]
__________________________________________________________________________________________________
conv2d_49 (Conv2D) (None, 32, 32, 10) 1690 concatenate_10[0][0]
__________________________________________________________________________________________________
batch_normalization_44 (BatchNo (None, 32, 32, 10) 40 conv2d_49[0][0]
__________________________________________________________________________________________________
conv2d_50 (Conv2D) (None, 32, 32, 10) 410 batch_normalization_44[0][0]
__________________________________________________________________________________________________
batch_normalization_45 (BatchNo (None, 32, 32, 10) 40 conv2d_50[0][0]
__________________________________________________________________________________________________
conv2d_transpose_13 (Conv2DTran (None, 64, 64, 2) 82 batch_normalization_45[0][0]
__________________________________________________________________________________________________
concatenate_11 (Concatenate) (None, 64, 64, 18) 0 conv2d_transpose_13[0][0]
max_pooling2d_8[0][0]
__________________________________________________________________________________________________
conv2d_51 (Conv2D) (None, 64, 64, 2) 146 concatenate_11[0][0]
__________________________________________________________________________________________________
batch_normalization_46 (BatchNo (None, 64, 64, 2) 8 conv2d_51[0][0]
__________________________________________________________________________________________________
conv2d_52 (Conv2D) (None, 64, 64, 2) 18 batch_normalization_46[0][0]
__________________________________________________________________________________________________
batch_normalization_47 (BatchNo (None, 64, 64, 2) 8 conv2d_52[0][0]
__________________________________________________________________________________________________
conv2d_transpose_14 (Conv2DTran (None, 128, 128, 2) 18 batch_normalization_47[0][0]
__________________________________________________________________________________________________
conv2d_53 (Conv2D) (None, 128, 128, 2) 18 conv2d_transpose_14[0][0]
==================================================================================================
Total params: 551,588
Trainable params: 550,244
Non-trainable params: 1,344
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x00000244A79A9730>
Training time: 5:26:57.929222
(648, 128, 128, 1)
Total round time: 5:27:04.321993
*** Leave-one-out round # 3
Training on 6580 images, validating on 738 images...
[<tf.Tensor 'conv2d_62/Relu:0' shape=(None, 4, 4, 128) dtype=float32>]
Model: "functional_7"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_4 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_54 (Conv2D) (None, 128, 128, 16) 160 input_4[0][0]
__________________________________________________________________________________________________
batch_normalization_48 (BatchNo (None, 128, 128, 16) 64 conv2d_54[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_12 (SpatialDr (None, 128, 128, 16) 0 batch_normalization_48[0][0]
__________________________________________________________________________________________________
conv2d_55 (Conv2D) (None, 128, 128, 16) 2320 spatial_dropout2d_12[0][0]
__________________________________________________________________________________________________
batch_normalization_49 (BatchNo (None, 128, 128, 16) 64 conv2d_55[0][0]
__________________________________________________________________________________________________
max_pooling2d_12 (MaxPooling2D) (None, 64, 64, 16) 0 batch_normalization_49[0][0]
__________________________________________________________________________________________________
conv2d_56 (Conv2D) (None, 64, 64, 32) 4640 max_pooling2d_12[0][0]
__________________________________________________________________________________________________
batch_normalization_50 (BatchNo (None, 64, 64, 32) 128 conv2d_56[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_13 (SpatialDr (None, 64, 64, 32) 0 batch_normalization_50[0][0]
__________________________________________________________________________________________________
conv2d_57 (Conv2D) (None, 64, 64, 32) 9248 spatial_dropout2d_13[0][0]
__________________________________________________________________________________________________
batch_normalization_51 (BatchNo (None, 64, 64, 32) 128 conv2d_57[0][0]
__________________________________________________________________________________________________
max_pooling2d_13 (MaxPooling2D) (None, 32, 32, 32) 0 batch_normalization_51[0][0]
__________________________________________________________________________________________________
conv2d_58 (Conv2D) (None, 32, 32, 64) 18496 max_pooling2d_13[0][0]
__________________________________________________________________________________________________
batch_normalization_52 (BatchNo (None, 32, 32, 64) 256 conv2d_58[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_14 (SpatialDr (None, 32, 32, 64) 0 batch_normalization_52[0][0]
__________________________________________________________________________________________________
conv2d_59 (Conv2D) (None, 32, 32, 64) 36928 spatial_dropout2d_14[0][0]
__________________________________________________________________________________________________
batch_normalization_53 (BatchNo (None, 32, 32, 64) 256 conv2d_59[0][0]
__________________________________________________________________________________________________
max_pooling2d_14 (MaxPooling2D) (None, 16, 16, 64) 0 batch_normalization_53[0][0]
__________________________________________________________________________________________________
conv2d_60 (Conv2D) (None, 16, 16, 128) 73856 max_pooling2d_14[0][0]
__________________________________________________________________________________________________
batch_normalization_54 (BatchNo (None, 16, 16, 128) 512 conv2d_60[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_15 (SpatialDr (None, 16, 16, 128) 0 batch_normalization_54[0][0]
__________________________________________________________________________________________________
conv2d_61 (Conv2D) (None, 16, 16, 128) 147584 spatial_dropout2d_15[0][0]
__________________________________________________________________________________________________
batch_normalization_55 (BatchNo (None, 16, 16, 128) 512 conv2d_61[0][0]
__________________________________________________________________________________________________
max_pooling2d_15 (MaxPooling2D) (None, 8, 8, 128) 0 batch_normalization_55[0][0]
__________________________________________________________________________________________________
conv2d_62 (Conv2D) (None, 4, 4, 128) 147584 max_pooling2d_15[0][0]
__________________________________________________________________________________________________
conv2d_transpose_15 (Conv2DTran (None, 8, 8, 58) 29754 conv2d_62[0][0]
__________________________________________________________________________________________________
concatenate_12 (Concatenate) (None, 8, 8, 186) 0 conv2d_transpose_15[0][0]
max_pooling2d_15[0][0]
__________________________________________________________________________________________________
conv2d_63 (Conv2D) (None, 8, 8, 58) 43210 concatenate_12[0][0]
__________________________________________________________________________________________________
batch_normalization_56 (BatchNo (None, 8, 8, 58) 232 conv2d_63[0][0]
__________________________________________________________________________________________________
conv2d_64 (Conv2D) (None, 8, 8, 58) 13514 batch_normalization_56[0][0]
__________________________________________________________________________________________________
batch_normalization_57 (BatchNo (None, 8, 8, 58) 232 conv2d_64[0][0]
__________________________________________________________________________________________________
conv2d_transpose_16 (Conv2DTran (None, 16, 16, 26) 6058 batch_normalization_57[0][0]
__________________________________________________________________________________________________
concatenate_13 (Concatenate) (None, 16, 16, 90) 0 conv2d_transpose_16[0][0]
max_pooling2d_14[0][0]
__________________________________________________________________________________________________
conv2d_65 (Conv2D) (None, 16, 16, 26) 9386 concatenate_13[0][0]
__________________________________________________________________________________________________
batch_normalization_58 (BatchNo (None, 16, 16, 26) 104 conv2d_65[0][0]
__________________________________________________________________________________________________
conv2d_66 (Conv2D) (None, 16, 16, 26) 2730 batch_normalization_58[0][0]
__________________________________________________________________________________________________
batch_normalization_59 (BatchNo (None, 16, 16, 26) 104 conv2d_66[0][0]
__________________________________________________________________________________________________
conv2d_transpose_17 (Conv2DTran (None, 32, 32, 10) 1050 batch_normalization_59[0][0]
__________________________________________________________________________________________________
concatenate_14 (Concatenate) (None, 32, 32, 42) 0 conv2d_transpose_17[0][0]
max_pooling2d_13[0][0]
__________________________________________________________________________________________________
conv2d_67 (Conv2D) (None, 32, 32, 10) 1690 concatenate_14[0][0]
__________________________________________________________________________________________________
batch_normalization_60 (BatchNo (None, 32, 32, 10) 40 conv2d_67[0][0]
__________________________________________________________________________________________________
conv2d_68 (Conv2D) (None, 32, 32, 10) 410 batch_normalization_60[0][0]
__________________________________________________________________________________________________
batch_normalization_61 (BatchNo (None, 32, 32, 10) 40 conv2d_68[0][0]
__________________________________________________________________________________________________
conv2d_transpose_18 (Conv2DTran (None, 64, 64, 2) 82 batch_normalization_61[0][0]
__________________________________________________________________________________________________
concatenate_15 (Concatenate) (None, 64, 64, 18) 0 conv2d_transpose_18[0][0]
max_pooling2d_12[0][0]
__________________________________________________________________________________________________
conv2d_69 (Conv2D) (None, 64, 64, 2) 146 concatenate_15[0][0]
__________________________________________________________________________________________________
batch_normalization_62 (BatchNo (None, 64, 64, 2) 8 conv2d_69[0][0]
__________________________________________________________________________________________________
conv2d_70 (Conv2D) (None, 64, 64, 2) 18 batch_normalization_62[0][0]
__________________________________________________________________________________________________
batch_normalization_63 (BatchNo (None, 64, 64, 2) 8 conv2d_70[0][0]
__________________________________________________________________________________________________
conv2d_transpose_19 (Conv2DTran (None, 128, 128, 2) 18 batch_normalization_63[0][0]
__________________________________________________________________________________________________
conv2d_71 (Conv2D) (None, 128, 128, 2) 18 conv2d_transpose_19[0][0]
==================================================================================================
Total params: 551,588
Trainable params: 550,244
Non-trainable params: 1,344
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x00000244A61B0370>
Training time: 5:22:03.631152
(738, 128, 128, 1)
Total round time: 5:22:10.622688
*** Leave-one-out round # 4
Training on 6689 images, validating on 629 images...
[<tf.Tensor 'conv2d_80/Relu:0' shape=(None, 4, 4, 128) dtype=float32>]
Model: "functional_9"
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_5 (InputLayer) [(None, 128, 128, 1) 0
__________________________________________________________________________________________________
conv2d_72 (Conv2D) (None, 128, 128, 16) 160 input_5[0][0]
__________________________________________________________________________________________________
batch_normalization_64 (BatchNo (None, 128, 128, 16) 64 conv2d_72[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_16 (SpatialDr (None, 128, 128, 16) 0 batch_normalization_64[0][0]
__________________________________________________________________________________________________
conv2d_73 (Conv2D) (None, 128, 128, 16) 2320 spatial_dropout2d_16[0][0]
__________________________________________________________________________________________________
batch_normalization_65 (BatchNo (None, 128, 128, 16) 64 conv2d_73[0][0]
__________________________________________________________________________________________________
max_pooling2d_16 (MaxPooling2D) (None, 64, 64, 16) 0 batch_normalization_65[0][0]
__________________________________________________________________________________________________
conv2d_74 (Conv2D) (None, 64, 64, 32) 4640 max_pooling2d_16[0][0]
__________________________________________________________________________________________________
batch_normalization_66 (BatchNo (None, 64, 64, 32) 128 conv2d_74[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_17 (SpatialDr (None, 64, 64, 32) 0 batch_normalization_66[0][0]
__________________________________________________________________________________________________
conv2d_75 (Conv2D) (None, 64, 64, 32) 9248 spatial_dropout2d_17[0][0]
__________________________________________________________________________________________________
batch_normalization_67 (BatchNo (None, 64, 64, 32) 128 conv2d_75[0][0]
__________________________________________________________________________________________________
max_pooling2d_17 (MaxPooling2D) (None, 32, 32, 32) 0 batch_normalization_67[0][0]
__________________________________________________________________________________________________
conv2d_76 (Conv2D) (None, 32, 32, 64) 18496 max_pooling2d_17[0][0]
__________________________________________________________________________________________________
batch_normalization_68 (BatchNo (None, 32, 32, 64) 256 conv2d_76[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_18 (SpatialDr (None, 32, 32, 64) 0 batch_normalization_68[0][0]
__________________________________________________________________________________________________
conv2d_77 (Conv2D) (None, 32, 32, 64) 36928 spatial_dropout2d_18[0][0]
__________________________________________________________________________________________________
batch_normalization_69 (BatchNo (None, 32, 32, 64) 256 conv2d_77[0][0]
__________________________________________________________________________________________________
max_pooling2d_18 (MaxPooling2D) (None, 16, 16, 64) 0 batch_normalization_69[0][0]
__________________________________________________________________________________________________
conv2d_78 (Conv2D) (None, 16, 16, 128) 73856 max_pooling2d_18[0][0]
__________________________________________________________________________________________________
batch_normalization_70 (BatchNo (None, 16, 16, 128) 512 conv2d_78[0][0]
__________________________________________________________________________________________________
spatial_dropout2d_19 (SpatialDr (None, 16, 16, 128) 0 batch_normalization_70[0][0]
__________________________________________________________________________________________________
conv2d_79 (Conv2D) (None, 16, 16, 128) 147584 spatial_dropout2d_19[0][0]
__________________________________________________________________________________________________
batch_normalization_71 (BatchNo (None, 16, 16, 128) 512 conv2d_79[0][0]
__________________________________________________________________________________________________
max_pooling2d_19 (MaxPooling2D) (None, 8, 8, 128) 0 batch_normalization_71[0][0]
__________________________________________________________________________________________________
conv2d_80 (Conv2D) (None, 4, 4, 128) 147584 max_pooling2d_19[0][0]
__________________________________________________________________________________________________
conv2d_transpose_20 (Conv2DTran (None, 8, 8, 58) 29754 conv2d_80[0][0]
__________________________________________________________________________________________________
concatenate_16 (Concatenate) (None, 8, 8, 186) 0 conv2d_transpose_20[0][0]
max_pooling2d_19[0][0]
__________________________________________________________________________________________________
conv2d_81 (Conv2D) (None, 8, 8, 58) 43210 concatenate_16[0][0]
__________________________________________________________________________________________________
batch_normalization_72 (BatchNo (None, 8, 8, 58) 232 conv2d_81[0][0]
__________________________________________________________________________________________________
conv2d_82 (Conv2D) (None, 8, 8, 58) 13514 batch_normalization_72[0][0]
__________________________________________________________________________________________________
batch_normalization_73 (BatchNo (None, 8, 8, 58) 232 conv2d_82[0][0]
__________________________________________________________________________________________________
conv2d_transpose_21 (Conv2DTran (None, 16, 16, 26) 6058 batch_normalization_73[0][0]
__________________________________________________________________________________________________
concatenate_17 (Concatenate) (None, 16, 16, 90) 0 conv2d_transpose_21[0][0]
max_pooling2d_18[0][0]
__________________________________________________________________________________________________
conv2d_83 (Conv2D) (None, 16, 16, 26) 9386 concatenate_17[0][0]
__________________________________________________________________________________________________
batch_normalization_74 (BatchNo (None, 16, 16, 26) 104 conv2d_83[0][0]
__________________________________________________________________________________________________
conv2d_84 (Conv2D) (None, 16, 16, 26) 2730 batch_normalization_74[0][0]
__________________________________________________________________________________________________
batch_normalization_75 (BatchNo (None, 16, 16, 26) 104 conv2d_84[0][0]
__________________________________________________________________________________________________
conv2d_transpose_22 (Conv2DTran (None, 32, 32, 10) 1050 batch_normalization_75[0][0]
__________________________________________________________________________________________________
concatenate_18 (Concatenate) (None, 32, 32, 42) 0 conv2d_transpose_22[0][0]
max_pooling2d_17[0][0]
__________________________________________________________________________________________________
conv2d_85 (Conv2D) (None, 32, 32, 10) 1690 concatenate_18[0][0]
__________________________________________________________________________________________________
batch_normalization_76 (BatchNo (None, 32, 32, 10) 40 conv2d_85[0][0]
__________________________________________________________________________________________________
conv2d_86 (Conv2D) (None, 32, 32, 10) 410 batch_normalization_76[0][0]
__________________________________________________________________________________________________
batch_normalization_77 (BatchNo (None, 32, 32, 10) 40 conv2d_86[0][0]
__________________________________________________________________________________________________
conv2d_transpose_23 (Conv2DTran (None, 64, 64, 2) 82 batch_normalization_77[0][0]
__________________________________________________________________________________________________
concatenate_19 (Concatenate) (None, 64, 64, 18) 0 conv2d_transpose_23[0][0]
max_pooling2d_16[0][0]
__________________________________________________________________________________________________
conv2d_87 (Conv2D) (None, 64, 64, 2) 146 concatenate_19[0][0]
__________________________________________________________________________________________________
batch_normalization_78 (BatchNo (None, 64, 64, 2) 8 conv2d_87[0][0]
__________________________________________________________________________________________________
conv2d_88 (Conv2D) (None, 64, 64, 2) 18 batch_normalization_78[0][0]
__________________________________________________________________________________________________
batch_normalization_79 (BatchNo (None, 64, 64, 2) 8 conv2d_88[0][0]
__________________________________________________________________________________________________
conv2d_transpose_24 (Conv2DTran (None, 128, 128, 2) 18 batch_normalization_79[0][0]
__________________________________________________________________________________________________
conv2d_89 (Conv2D) (None, 128, 128, 2) 18 conv2d_transpose_24[0][0]
==================================================================================================
Total params: 551,588
Trainable params: 550,244
Non-trainable params: 1,344
__________________________________________________________________________________________________
TRAINING LOG <ultrasound_batch_generator.UltrasoundSegmentationBatchGenerator object at 0x00000244A30890A0>
Training time: 5:28:15.647152
(629, 128, 128, 1)
Total round time: 5:28:21.654835
Total training time: 1 day, 2:19:26.001064